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(54) Image enhancement processing apparatus and method 



(57) The present invention discloses an image 
processing apparatus and an image processing method 
for varying the gradation characteristics of the image, by 
inputting an image signal, detecting the histogram distri- 
bution characteristics of pixel values constituting the 
image represented by the inputted image signal and 
converting the detected histogram characteristics into 
arbitrary histogram characteristics. Thus the gradation 
characteristics of plural images obtained from a same 

FIG. 3 



portion of the object can be converted into desired gra- 
dation characteristics, and the gradation characteristics 
of an image obtained by a substrate image processing 
apparatus can be converted close to the gradation char- 
acteristics of the taken original images, whereby the 
deterioration in the efficiency of diagnosis can be pre- 
vented. 
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Description 

BACKGROUND OF THE INVENTION 
Field of the Invention 

[0001] The present invention relates to an image 
processing apparatus and an image processing method 
adapted for use in an image processing apparatus for 
converting the gradation characteristics of plural images 
taking a same portion of an object, and more particu- 
larly to an image processing apparatus and an image 
processing method adapted for use, for example in the 
medical radiology field or the like, in a subtraction image 
processing apparatus for processing plural radiological 
images obtained by radiological image takings of an 
object under different image taking conditions. 

Related Background Art 

[0002] The X-ray radiological images for medical pur- 
pose have long been obtained by converting the inten- 
sity distribution of X-ray transmitted by the human body 
into the intensity distribution of fluorescent light of a flu- 
orescent member and recording such light intensity dis- 
tribution directly on a silver halide-based film, but in 
recent years, the radiological images are being read in 
the form of electrical signals by a method of forming and 
reading a latent energy image representing the X-ray 
intensity distribution in a photostimulable fluorescent 
member, a method of directly reading the distribution of 
fluorescent light generated on a fluorescent member by 
X-ray or a method not depending on the fluorescent 
light, and a digital image is obtained by digital conver- 
sion of such electrical signals. 

[0003] The use of such digital image allows to improve 
the efficiently of filing, to implement remote diagnosis, 
and to achieve improvements in the diagnostic technol- 
ogies and efficiency. In addition, such digital image ena- 
bles various image processing, thus realizing various 
changes in the method of diagnosis. 
[0004] Among such image processing, most common 
is the gradation processing. As an example, a regular 
conversion of the pixel values within the image allows to 
enhance a pattern that is not easily recognizable in the 
original image, into a more easily recognizable form. 
Also even in case the condition of radiological image 
taking is inappropriate or unstable, the image that would 
be unusable on the conventional X-ray film can be recti- 
fied to stable gradation characteristics by appropriate 
gradation processing. 

[0005] Among such gradation processing, the averag- 
ing of histogram (frequency distribution of pixel values) 
is simplest and most commonly employed, but this 
method may be unsuitable for diagnostic purpose since 
it only executes straight-forward averaging by broaden- 
ing concentrated portions of the frequency distribution 
of the pixel values in the entire image and*narrowing or 



uniting less dense portions of the frequency distribution. 
The image used for diagnosis has been developed over - 
a long history based on the conventional silver halide- 
based X-ray film, and, for the radiologists, the gradation 

5 characteristics (appearance of image) similar to those 
of the conventional X-ray film are better for the efficiency 
and accuracy of diagnosis. More specifically, the histo- 
gram of the image of the conventional silver halide- 
based X-ray film is naturally not flat but characteristically 

to describes the area of disease by the image taking tech- 
nology developed over many years, and the radiologists 
have been so trained as to identify the diseases based 
on such form of image presentation. 
[0006] It is therefore desired, also in the gradation 

is processing of the digital image, to effect conversion into 
such image enabling easy diagnosis in stable manner. 
Such objective has been attained by processing the 
image, obtained by a digital image taking device with 
characteristics significantly different from those of the 

20 conventional silver halide-based film, through a consid- 
erably complex process including empirical methods, 
but a first drawback lies in a fact that such process inev- 
itably involves a generally very long processing time 
and cumbersome operations. 

25 [0007] A large advantage of image digitization lies in 
the ease of filing and retrieval of the image. For exam- 
ple, it is rendered possible to promptly investigate the 
change in the disease in a same patient by retrieving 
and comparing the image filed in the past. If the image 

30 taken in the past was obtained under different image 
taking conditions, the difference in such image taking 
conditions can be canceled by applying a gradation 
processing. However, there is encountered a second 
drawback that a cumbersome process is required for 

35 substantially matching the gradation of the past image 
with that of the current image. 

[0008] Also in case of obtaining an image correspond- 
ing to the distribution of transmittance for a radiation 
such as X-ray thereby showing the internal structure of 

40 an object, there are conventionally been known so- 
called energy subtraction process of utilizing two radia- 
tions of different energy distributions to obtain two 
images corresponding to the distribution of transmit- 
tance, based on a fact that a specified constituent in the 

45 interior of the object has specific radiation transmittance 
(or absorbing characteristics for the energy of radia- 
tion), then digitizing these images and effecting a calcu- 
lation between these images to extract or erase the 
specified constituent in the interior of the object. In the 

so processing of medical X-ray images, such process is 
considered extremely useful for diagnostic purpose, 
such as erasure or extraction of a bone portion. 
[0009] Fig. 1 shows a conventional energy subtraction 
apparatus, in which provided are a tube 101 for gener- 

55 ating X-ray; a human body 1 02 constituting the object; a 
CCD 103 constituting a solid-state image pickup device 
for separating the distribution of radiation into pixels 
thereby obtaining an electrical signal; an A/D converter 
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104 for converting an analog electrical signal into digital 
values; an offset/gain correction unit 105 for correcting 
the fluctuation in the offset-gain of the CCD 1 03; a loga- 
rithmic conversion unit 106 for converting digital values, 
proportional to the obtained radiation intensity, into log- 5 
arithmic values; memories 107, 108 serving to store the 
image data and connected to a signal bus 1 1 1 ; a central 
processing unit (CPU) 109 capable of access to the 
memories 107, 108 through the bus 111; and a program 
memory medium 110 such as a FD, a HD or a MOD in 
which the process sequence is stored as a program. 
The final image obtained after energy subtraction is 
stored in a memory 112 connected to the bus 111. 
[001 0] In the following there will be explained the func- 
tion of the apparatus described above. At first the X-ray 
tube 101 emits X-ray with a first energy distribution, and 
the obtained image is converted in the CCD 103 into an 
electrical signal, which is converted by the A/D con- 
verter 104 into digital values. After the correction in the 
offset/gain correction unit 105 and the conversion into 
values corresponding to logarithmic values in the loga- 
rithmic conversion unit 106, the digital values are once 
stored in the memory 107. Then the X-ray tube 101 
emits the X-ray with a second energy distribution, and 
the image obtained by logarithmic conversion in a simi- 
lar process is stored in the memory 108. 
[001 1 ] Then considered is a pixel in the logarithmically 
converted two images obtained in the above-described 
manner, and such pixel is assumed to receive X-ray that 
has transmitted a bone and a soft tissue in the human 
body. 

[0012] In the first energy distribution, the intensity H 1 
of transmitted radiation is given by: 

H 1 =l 1 exp(- f i 1 t 1 )exp(-n 2 t 2 ) (1) 

wherein n 1( \i 2 are radiation transmittances of respec- 
tively bone and soft tissue, t t , t 2 are thicknesses thereof, 
and ^ is the intensity of first incident radiation in this 
portion. 

[0013] Similarly the intensity H 2 of transmitted radia- 
tion in the second energy distribution is given by: 

H 2 = l 2 exp(-^ 1 t 1 )exp(-n' 2 t 2 ) (2) 

wherein n' 1f \x 2 are radiation transmittances of respec- 
tively bone and soft tissue, t t , t 2 are thicknesses thereof, 
and l 2 is the intensity of second incident radiation in this 
portion. 

[001 4] As digital data proportional to these logarithmic 
conversions are stored as pixel values, the correspond- 
ing pixel data 1^ , h 2 are given by: 

h 1 =K(n 1 t 1 +u 2 t 2 )+C 1 (3) 

h 2 = K(n' 1 t 1+ n' 2 t 2 )+C 2 (4) 

wherein K, and C2 are constants. • 



[001 5] These equations (3) and (4) are considered as 
simultaneous equations, and, if the transmittances or 
the ratio thereof is known, the thickness t 1 of the bone 
and that t 2 of the soft tissue can be obtained as sums 
with a constant offset value. Since such offset value is 
substantially constant over the entire image, a suitable 
offset value is added or the image is inverted in order to 
render the image more visible or to eliminate negative 
pixel data, and the energy subtraction image thus 
obtained is stored in the memory 112. 
[0016] It is naturally possible also to obtained images 
under plural conditions instead of two conditions, and to 
suitably process such plural images to obtain a single 
image in which one or plural portions are erased or 
enhanced. 

[0017] The diagnosis with the X-ray image has a long 
history, and, based on the experience in such history, 
the radiologists are accustomed to the ordinary image 
density distribution specific to the human body and are 
trained for diagnosis utilizing such distribution. Conse- 
quently the image obtained by energy subtraction, for 
example showing soft tissues such as blood vessels or 
tumor only by erasure of the bones, is merely the solu- 
tion of the simultaneous equations (3) and (4) and is dif- 
ferent from the original X-ray transmittance. Therefore 
the gradation characteristics of the image are different 
from those to which the radiologists are used, and the 
efficiency of diagnosis may be deteriorated. 
[0018] Furthermore, the image obtained by energy 
subtraction shows different gradation characteristics 
based on the image taking conditions (two X-ray energy 
distributions), so that stable gradation independent of 
the image taking condition cannot be obtained by mere 
correction of the offset. 

SUMMARY OF THE INVENTION 

[0019] An object of the present invention is to provide 
an image processing apparatus and an image process- 
ing method capable of solving the above-described 
drawbacks. 

[0020] Another object of the present invention is to 
provide an image processing apparatus and an image 
processing method capable of converting the gradation 
characteristics of plural images taking a same part of 
the object into an image with desired gradation charac- 
teristics in a simple manner. 

[0021 ] The above-mentioned objects can be attained, 
according to an embodiment of the present invention, by 
an image processing apparatus capable of varying the 
gradation characteristics of image, comprising histo- 
gram distribution characteristic detecting means for 
inputting an image signal and detecting the histogram 
distribution characteristic of the pixel values constituting 
the image represented by the inputted image signal, 
and histogram distribution characteristic converting 
means for converting the histogram distribution charac- 
teristic, detected by the histogram distribution charac- 
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teristic detecting means, into an arbitrary histogram 
distribution characteristic. 

[0022] Still another object of the present invention is 
to provide an image processing apparatus and an 
image processing method, capable of converting the 
gradation characteristics of an image obtained by a sub- 
traction image processing apparatus so as to be similar 
to the gradation characteristics of the originally taken 
image. 

[0023] The above-mentioned object can be attained, 
according to an embodiment of the present invention, by 
an image processing apparatus for processing plural 
images obtained under mutually different image taking 
conditions, comprising differential image signal generat- 
ing means for inputting plural image signals corre- 
sponding to plural images obtained under mutually 
different image taking conditions and generating a dif- 
ferential image signal corresponding to a differential 
image of the images represented by the inputted plural 
image signals, and histogram distribution characteristic 
converting means for inputting the differential image sig- 
nal generated by the differential image signal generat- 
ing means and converting the histogram distribution 
characteristic of the pixels values, constituting the differ- 
ential image represented by the inputted differential 
image signal, into an arbitrary histogram distribution 
characteristic. 

[0024] Still other objects of the present invention, and 
the features thereof, will become fully apparent from the 
following detailed description of the embodiments, 
which is to be taken in conjunction with the attached 
drawings. 

BRIEF DESCRIPTION OF THE DRAWINGS 
[0025] 

Rg. 1 is a block diagram of a conventional energy 
subtraction apparatus; 

Fig. 2 is a characteristic charts showing the princi- 
ple of a first invention; 

Fig. 3 is a block diagram of a first embodiment of 
the first invention; 

Rg. 4 is a block diagram of a second embodiment 
of the first invention; 

Rg. 5 is a block diagram of a third embodiment of 
the first invention; 

Fig. 6 is a flow chart showing the functions common 
to the f irst to third embodiments; 
Rg. 7 is a block diagram of a fourth embodiment of 
the first invention; 

Rg. 8 is a flow chart showing the functions of the 
fourth embodiment; 

Rg. 9 is a characteristic charts showing the princi- 
ple of a second invention; 

Rg. 10 is a block diagram of an embodiment of the 
second invention; and 

Rg.11 is a flow chart showing the fuhctions of the 
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embodiment shown in Fig. 10. 

DETAILED DESCRIPTION OF THE PREFERRED 
EMBODIMENTS 

5 

[0026] In the following there will be explained embod- 
iments of a first invention, with reference to attached 
drawings. 

[0027] At first there will be explained the principle of 

10 the image processing method of the first invention. 
[0028] In a first step in this method, there is prepared 
a gradation conversion table for flattening the histogram 
of a standard image, and an inverse conversion table 
therefor is prepared. 

75 [0029] In a next step, there is prepared a gradation 
conversion table for flattening the histogram of an arbi- 
trary general image, and the image is subjected to gra- 
dation conversion with such gradation conversion table. 
In this step the histogram of the arbitrary general image 

20 is flattened. 

[0030] In a final step, the arbitrary general image with 
thus flattened histogram is subjected to gradation con- 
version with the above-mentioned inverse conversion 
table for the standard image. 

25 [0031 ] This three-step method allows to convert the 
histogram of the arbitrary general image to a gradation 
substantially same as the histogram of the standard 
image. 

[0032] The histogram of a digital image is obtained by 
30 a frequency distribution of pixel values x of the image 
within an entire image or a part thereof. By representing 
the histogram with f(x), the histogram flattening method 
is to so deform f(x) as to obtain an approximately uni- 
form density of distribution. Such flattening of histogram 
35 is realized by passing the image data through a grada- 
tion conversion table H(x) showing in the following: 

40 H(x) = j=MO (MUM0)+M0,M0iZx<,M1 (5) 

45 wherein M0 and M1 are respectively the minimum and 
maximum values of the digital data, in which the depth 
(number of bits) of the input digital data is selected 
same as that of the output digital data (for example in 
the ordinary 12-bit data, M0 = 0 and M1 = 4095). It can 

so be easily estimated that such gradation conversion 
table H(x) can convert the gradation of the original 
image with a histogram f(x) to an approximately flat den- 
sity of distribution. 

[0033] The above-described first step prepares a his- 
55 togram flattening gradation conversion table H 0 (x) from 
the histogram f 0 (x) of a standard image, utilizing the 
equation (5), and then prepares an inversion conversion 
table H 0 *(x). Since H 0 (x) is generally not an analytically 
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determined function, the inverse conversion table H 0 *(x) 
which is an inverse function cannot be determined in an 
analytical manner, but a conversion table providing an 
inverse relationship between the input and the output 
can be easily determined through a simple routine pro- 5 
gram. Otherwise it is also possible to approximate H(x) 
with an analytical function (for example by least square 
method) and to analytically approximate H*(x). 
[0034] The inverse conversion table H 0 *(x) thus deter- 
mined evidently has a function of converting an image 10 
with a flattened histogram into an image having a histo- 
gram similar to that of the standard image. This situation 
is illustrated in Fig. 2, in which (a) indicates the histo- 
gram f 0 (x) of the standard image, with the pixel values in 
the abscissa and the frequency in the ordinate. In Fig. 2, 15 
(b) shows a gradation conversion table H 0 (x) for flatten- 
ing the histogram, in which the abscissa indicates the 
input and the ordinate indicates the output, while (c) 
schematically shows a flattened histogram of an output 
image, obtained by passing the image of the histogram 20 

(a) through the conversion table of the input-output 
characteristics (b). 

[0035] The flow (a) (b) -» (c) shown in Fig. 2 can be 
traced in the inverse order so that a conversion (c) — ► (b) 
-» (a) is also possible (though such conversion is not 25 
completely reversible since some information is inevita- 
bly lost in the conversion with the table of a limited 
number of gradation level). In such inverse conversion, 

(b) corresponds to the inverse function H 0 *(x) in which 
the ordinate indicates the input and the abscissa indi- 30 
cates the output. 

[0036] In the above-described second step, an arbi- 
trary general image of a histogram different from that of 
the standard image is subjected to the flattening of his- 
togram also according to the equation (5). More specif i- 35 
cally, this step prepares a histogram flattening gradation 
conversion table H^x) from the histogram f,(x) of 
another image, utilizing the equation (5), as shown in 
Fig. 2, in which (d) indicates the histogram f -,(x), with the 
pixel values in the abscissa and the frequency in the 40 
ordinate. In Fig. 2, (e) shows a histogram flattening gra- 
dation conversion table H^x), in which the abscissa 
indicates the input and the ordinate indicates the output, 
while (c) shows a histogram flattened as a result 
[0037] In the final step mentioned in the foregoing, as 45 
the image of the flattened histogram (c) is converted 
through the table H 0 *(x) shown in (b), it will be easily 
understood that an image having the standard histo- 
gram (a) can be obtained as the result of such conver- 
sion. 50 
[0038] In the foregoing explanation, it is to be noted 
that, since the image consists of discrete digital values, 
the histogram is not made completely flat but only 
shows an approximately constant density in general 
sense, so that the histogram of the final image obtained 55 
through the above-described three steps does not com- 
pletely coincide with the histogram of the standard 
image. However, the images will be retognized, by the 



human eyes, to have substantially coinciding character- 
istics if the histograms mutually match in general sense. 
[0039] In the following there will be explained first to 
sixth embodiments of the first invention, based on the 
principle described above. 

[0040] At first there will be explained first to third 
embodiments, which are to solve the aforementioned 
drawbacks and realize a gradation processing for 
matching the histogram of an arbitrary image with that 
of the standard image by a simple process, utilizing an 
image, which has been subjected to the conversion of 
the gradation to a state suitable for diagnosis, as the 
standard image and also utilizing a fact that the fre- 
quency distribution (histogram) of an image so proc- 
essed as to be suitable for diagnosis remains 
substantially same for a given photographed portion of 
the human body. 

[0041] Now there will be explained the first embodi- 
ment. 

[0042] Fig. 3 is a block diagram of an X-ray image 
reading system embodying the present invention, 
wherein provided are an X-ray generating device 1 ; a 
human body 2 constituting the object; an image pickup 
element 3 for converting the intensity distribution of X- 
ray into an electrical signal; an A/D converter 4 for con- 
verting the output of the image pickup element 3 into 
digital values; an offset memory 6 for correcting the fluc- 
tuation in the dark output of the image pickup element 3; 
a logarithmic converter 7 for effecting a logarithmic con- 
version for an ensuing dividing operation; a shading dis- 
tribution memory 8 for correcting the fluctuation in the 
gains of the image pickup element 3 or in the distribu- 
tion of X-ray radiation; and an inverse logarithmic con- 
verter 21 for applying, in a final step of dividing 
operation, an inverse logarithmic conversion to the log- 
arithmically converted pixel data thereby obtaining val- 
ues linear to the X-ray intensity. 

[0043] A controller 5 including a CPU for controlling 
the entire image fetching process is connected to vari- 
ous blocks of the image fetching unit and controls the 
image fetching in synchronization with the generation of 
X-ray by the X-ray generating device 1. Besides, it is 
also connected to the converters and the gradation con- 
version tables though connections are omitted in Fig. 1 , 
and effects control according to a program stored in a 
memory medium 24. The memory medium 24 storing 
the program can for example be a ROM, a FD, a CD- 
ROM, a HD, a memory card or a magnetooptical disk. 
[0044] There are further provided a memory controller 
9 for automatically preparing the histogram; a histogram 
memory 10 for storing the histogram of the image; a 
frame memory 12 for temporarily storing the acquired 
image; a first gradation conversion table 13 which 
stores histogram flattening conversion data prepared by 
a conversion data preparation unit 1 1 ; a second grada- 
tion conversion table 1 4 which stores gradation conver- 
sion data prepared by the controller; an interface 15 for 
outputting the image data to the exterior; and subtrac- 
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tors 22, 23. 

[0045] A broken-lined area 20 is an external image 
storage processing unit for processing the storage of 
image, in which provided are a filing unit 19 for filing the 
image data; an operation console 1 7 inducing an image 
monitor; a printer 18 for printing the image on a film etc; 
an interface 16 for re-writing the gradation conversion 
table 13 according to the result of processing in the 
image storage processing unit 20; and a bus 25. 
[0046] A central process unit (CPU) 26 controls the 
entire system according to a program stored in a mem- 
ory medium 27, which can for example be a ROM, a FD, 
a CD-ROM. a HD, a memory card or a magnetooptical 
disk. 

[0047] In the following there will be explained the func- 
tions of the system. At first the controller 5 fetches the 
dark output of the image pickup element 3 while the X- 
ray is not generated from the X-ray generating device 1 , 
and converts such output into a digital value in the A/D 
converter 4 and stores the digital value in the offset 
memory 6. Then the X-ray is generated in the absence 
of the object 2, thereby fetching the distribution of the X- 
ray radiation, and, after the subtraction of the above- 
mentioned dark output in the subtracter 22, the distribu- 
tion is logarithmically converted in the logarithmic con- 
verter 7 and is stored in the shading distribution 
memory 8. 

[0048] Then the standard image is prepared in the fol- 
lowing manner. Prior to fetching of the image, all the 
addresses of the histogram memory 10 are cleared to 
zero. Then the X-ray is generated in the presence of the 
object 2 between the X-ray generating device 1 and the 
image pickup element 3, and the image pickup element 
3 converts the distribution of X-ray intensity into an elec- 
trical signal. The electrical signal is converted into dig- 
ital values (read pixel values), and the dark outputs of 
the corresponding positions are read from the offset 
memory 6 and are respectively subtracted from the read 
pixel values. Then thus subtracted read pixel values are 
subjected to logarithmic conversion, and the X-ray radi- 
ation distribution of the corresponding positions is read 
from the shading distribution memory 8 and subtracted 
in the subtracter 23. The obtained data are subjected to 
inverse logarithmic conversion, and are once stored in 
the frame memory 12. These data are pixel data repre- 
senting the internal structure of the object 2, after cor- 
rection for the fluctuation in the image pickup element 3 
and for the distribution of the X-ray radiation. 
[0049] Simultaneous with the above-described opera- 
tions, in the course of reading of the pixel data, the 
memory controller 9 stepwise increases the value of the 
histogram memory 10 at an address corresponding to 
the value of the read pixel data. Consequently, when all 
the image data are fetched into the frame memory 12, 
the histogram of the image is automatically stored in the 
histogram memory 10. As the flattening of histogram is 
not executed in this fetching of the standard image, the 
gradation conversion table 13 stores lihear data in 



which input : output =1:1 and the above-described his- 
togram is not particularly utilized. Also linear 1 : 1 data 
are stored in the gradation conversion table 14 since 
this table is not particularly employed. The image data 
5 thus obtained are outputted to the external image stor- 
age processing unit 20 through the interface 15 and are 
filed in the filing unit 19. 

[0050] After fetching an image through the above- 
described operations, the operator manually executes a 
10 gradation process, by the operation console 17 of the 
image storage processing unit 20. in such a manner that 
the diseased portion of the object patient is described 
characteristically, or that the output result of the printer 
18 matches the characteristics of the conventional silver 
is halide-based film or characteristically describes the dis- 
eased portion or matches the taste of the radiologist, 
and such image is registered as the standard image. 
Subsequently the histogram of such standard image (a) 
in Fig. 2 is prepared according to the equation (5), then 
20 the gradation conversion table for histogram flattening 
(b) in Fig. 2 is prepared through the interface 16, and 
the inverse conversion table therefor is prepared and 
written in the second gradation conversion table 1 4. 
[0051] In the following there will be explained a case 
25 of histogram conversion by fetching an image showing a 
same portion as that of the standard image, utilizing 
thus prepared inversion conversion table on the stand- 
ard image. 

[0052] The procedure in this case is substantially 
30 same as that explained in the foregoing, except that, 
after the image fetching, the conversion data prepara- 
tion unit 1 1 automatically prepares a histogram flatten- 
ing gradation conversion table (e) in Fig. 2 according to 
the equation (5), utilizing the histogram prepared in the 
35 histogram memory 10, and stores such prepared con- 
version table in the gradation conversion table 13. 
[0053] Then, when the image to be converted is read 
from the frame memory 12 to the image storage 
processing unit 20, the reading is executed serially 
40 through the first gradation conversion table 13 and the 
second gradation conversion table 14, whereby a flow 
(d) -> (e) (c) -> (b) -> (a) in Fig. 2 can be realized and 
there can be obtained an image of a histogram compa- 
rable to that of the standard image fetched in advance. 
45 [0054] In the present embodiment, the f irst gradation 
conversion table 13 and the second gradation conver- 
sion table 14 are separated for the ease of description, 
but they may also be synthesized into a conversion 
table, and, in such case, there is employed a single gra- 
50 dation conversion table obtained by synthesizing two 
gradation conversion tables. 

[0055] Also in the present embodiment, the image 
subjected to the gradation process by the operator is 
adopted as the standard image, but if it is intended to 
55 match the output result of the printer 1 8 with the charac- 
teristics of the conventional silver halide-based film, the 
standard image can also be prepared by digitizing, for 
example with a film digitizer, a conventional silver hal- 
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ide-based film taken in advance, whereby there can be 
dispensed with the gradation process to be executed by 
the operator for obtaining the standard image. 
[0056] Also in the present embodiment, the histogram 
is prepared automatically through a hardware process, 5 
but such histogram may also be prepared through a 
software process, either by the controller 5 on the frame 
memory 12 or by a program on tine memory medium 27 
at the acquisition of the image data. 
[0057] In the following there will be explained a sec- w 
ond embodiment with reference to Fig. 4. 
[0058] The configuration shown in Fig. 4 is different 
from that shown in Fig. 3 in that the image storage 
processing unit 20 is dispensed with and in that the con- 
version data preparation unit 1 1 functions differently in is 
writing into the gradation conversion table 13 and in 
writing into the gradation conversion table 14. 
[0059] The present embodiment does not employ, as 
the standard image, an image obtained by image 
processing or with a digitizer, but employs an image 20 
obtained under optimum image taking conditions. 
[0060] When an image suitable as standard is 
obtained depending on the object and the image taking 
conditions, the operator sets such image as the stand- 
ard image by unrepresented input means. In response, 25 
the histogram flattening conversion data preparation 
unit 1 1 executes flattening of the histogram according to 
the equation (5), utilizing the data of the histogram 
memory 10, then prepares the inverse conversion table 
therefor and writes it in the gradation conversion table 30 
14. 

[0061] At the acquisition of an ordinary image, simul- 
taneous with the fetching of each image in the frame 
memory 12, the conversion data preparation unit 11 
prepares the gradation conversion table for histogram 35 
flattening according to the equation (5), and writes it in 
the gradation conversion table 13. Thus the histogram 
of the ordinary image, outputted from the interface 15 to 
the external equipment, is automatically converted sim- 
ilar to the histogram of the standard image. 40 
[0062] Fig. 5 shows the configuration of a third 
embodiment, wherein provided are a group of memo- 
ries 28 for inverse conversion of plural histograms, and 
a selection unit 29 for selecting such memories for writ- 
ing into the second gradation conversion table 1 4. Other 45 
parts of the configuration are same as those shown in 
Fig. 4. 

[0063] The histogram of the standard image naturally 
varies in various manners, according to the taken por- 
tion of the object, the kind of disease to be described, so 
the taste of the diagnosing radiologist. Histograms con- 
sidered as standards are acquired in advance, and the 
inverse conversion tables for the standard histogram 
flattening are stored in the plural memories 28. 
[0064] Prior to the actual image taking, the operator 55 
selects a desired histogram flattening inverse table from 
the memories 28 through the selection unit 29 control- 
led by unrepresented means. At the Acquisition of an 



ordinary image, simultaneous with the fetching of each 
image in the frame memory 12, the conversion data 
preparation unit 1 1 prepares the gradation conversion 
table for histogram flattening according to the equation 
(5), and writes it in the gradation conversion table 13. 
Thus the histogram of the ordinary image, outputted 
from the interface 15 to the external equipment, is auto- 
matically converted similar to the histogram of the 
standard image. 

[0065] As in the first embodiment, similar effects can 
also be obtained by providing plural standard histo- 
grams or inverse histogram flattening gradation conver- 
sion tables outside the system and selecting such 
histograms or tables. 

[0066] Also the gradation conversion tables for histo- 
gram flattening and inverse flattening need not neces- 
sarily be separated but there may also be employed a 
single gradation conversion table, obtained by synthe- 
sizing these tables, for obtaining a similar effect 
[0067] Also in matching the histogram in the foregoing 
first to third embodiments, there may be employed the 
histogram of a specified portion of the image instead of 
the entire image, for histogram matching. 
[0068] Fig. 6 is a flow chart of a program process of 
an external filing device common to the foregoing first to 
third embodiments. Referring to Fig. 6. a step S1 
selects a standard image, based on the result of image 
processing or of film digitizing, or on an image taken 
under appropriate conditions. Then a step S2 deter- 
mines the histogram f(x) of the standard image. A step 

53 prepares the gradation conversion table H(x) of his- 
togram flattening according to the equation (5). A step 

54 prepares an inverse conversion table of H(x), by fit- 
ting H(x) with a program of exchanging the address and 
the data or with an analytical function, and analytically 
determining an inverse function. Then a step S5 
rewrites the gradation conversion table 13 through the 
interface 16. 

[0069] In the following there will be explained fourth to 
sixth embodiments, which are to solve the aforemen- 
tioned drawbacks and are to realize in a similar manner 
a gradation process capable of providing, for an arbi- 
trary image, a histogram same as that of the standard 
image, employing a given image as the standard image 
and utilizing a fact that the appearance of the image 
substantially depends on the frequency distribution (his- 
togram) if the taken portion remains same. 
[0070] At first there will be explained the fourth 
embodiment 

[0071] Fig. 7 shows the configuration of an image 
processing apparatus embodying the first invention, 
wherein provided are a central processing unit (CPU) 
31 for controlling the entire apparatus; a bus 32 con- 
necting the internal units; an operation console 33 
which is to be operated by the operator under the obser- 
vation of the image and of which monitor can be used 
for simple diagnosis; and another operation console 34 
with a monitor. The operator can execute comparative 
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investigation, by simultaneously observing the monitors 
of the two operation consoles 33, 34. The number of 
monitors is not limited to two but can be made larger. 
There are also provided a printer 35 for outputting the 
image for example on a silver halide-based film; an 
image filing unit 36; and an interface 37 for fetching the 
image data for example from an external image reading 
apparatus to the present image processing apparatus. 
[0072] A memory medium 38 stores a program, 
according to which the CPU 31 functions. The opera- 
tions of the present embodiment are all realized by this 
program. The memory medium 38 can for example be a 
ROM, a FD, a CD-ROM, a HD, a memory card or a mag- 
netooptical disk. 

[0073] The functions of the present apparatus will be 
explained with reference to Fig. 8. At first a step S1 1 
fetches the diagnostic image (image A) of a patient into 
the present image processing apparatus. A next step 
S1 2 retrieves and extracts a past image of the same 
patient from the filing unit 36, and a step S13 names 
such image as an image B. In order to compare the past 
image and the present image on the above-mentioned 
two monitors, the gradation characteristics of the 
images have to be approximately matched. 
[0074] A next step S14 determines the histogram of 
the past image B. A step S15 calculates the histogram 
flattening gradation conversion table H 0 (x) (x being pixel 
value) for the image B. A step S16 calculates the 
inverse conversion table H 0 *(x) for H 0 (x). Such calcula- 
tion can be achieved by a program process for exchang- 
ing the address and the data, but it can also be achieved 
by fitting the table data to an analytical function and cal- 
culating the inverse function of such analytical function. 
[0075] On the other hand, parallel to the foregoing 
process, a step S17 determines the histogram of the 
image A, then a step S18 prepares the gradation con- 
version table H^x) for flattening such histogram, and a 
step S19 executes the gradation conversion of the cur- 
rent image with H^x) (obtained image being called 
image A*). 

[0076] Ttien a step S20 executes the gradation con- 
version of the image A' with the inverse conversion table 
H 0 *(x) to obtain an image A". The images A" and B have 
approximately same histograms, so that the operator or 
the radiologist can compare the past image and the 
image B to detect the change in the diseased portion or 
in the disease of the patient. 

[0077] In the foregoing description, the past image B 
is taken as the standard image, but the current image A 
may also be adopted as the standard image. In such 
case the gradation conversion table for inverse flatting 
of the histogram of the current image A, and the grada- 
tion conversion for the past image B may be conducted 
by passing the gradation conversion table for histogram 
flattening and then the above-mentioned gradation con- 
version table for inverse histogram flattening. 
[0078] The operator can compare thus obtained 
images A" and B by recording these imagfes on another 



medium by the printer 35. or by displaying these images 
on one or both of the two monitors. 
[0079] The present invention can also be realized by 
supplying the system of the apparatus with the memory 
5 medium 38 storing the program and by reading and exe- 
cuting the program codes by a computer of the system 
or the apparatus. 

[0080] In the following there will be explained a fifth 
embodiment of the present invention. 

10 [0081] Instead of selecting a past image of the same 
patient as the standard image, it is also possible to 
match the histogram with that of an image allowing to 
extract the features of the common disease. If there are 
plural images empirically known as suitable for extract- 

15 ing specific disease, the histograms of such images can 
be averaged to derive a standard histogram suitable for 
extracting such disease. 

[0082] There is determined the gradation conversion 
table for inverse flattening of such histogram, and an 

20 ordinary image for diagnosis is at first subjected to his- 
togram flattening and then to gradation matching by 
such inverse flattening gradation conversion table, 
whereby all the images can be changed to uniform gra- 
dation characteristics and the efficiency of diagnosis 

25 can be improved. 

[0083] Instead of obtaining the standard histogram 
suitable for disease extraction from the actual image, it 
is also possible to draw an ideal form of the histogram 
and to prepare the gradation conversion table for 

30 inverse flattening of such histogram. 

[0084] In the following there will be explained a sixth 
embodiment 

[0085] The standard image or the standard histogram 
is variable depending on the diseased portion, the 

35 imaged portion of the human body or the taste of the 
radiologist, and it is inefficient to calculate such stand- 
ard image or standard histogram every time. In the 
present embodiment, therefore, plural gradation conver- 
sion tables for inverse flattening of the histogram are 

40 stored in the filing system of the image processing 
apparatus, according to the difference in the diseased 
portions, in the imaged portions of the human body or in 
the taste of the radiologist. 

[0086] The operator selects, through the operation 
45 console, one of the plural gradation conversion tables 
for inverse flattening of the histogram, according to the 
purpose of use of the image or the imaged portion of the 
human body. Then a general image is subjected to his- 
togram flattening and then to gradation conversion by 
so thus selected gradation conversion table for inverse flat- 
tening of the histogram, whereby the image of desired 
gradation characteristics can be obtained promptly. 
[0087] In the foregoing embodiments, there are 
always executed two gradation conversions, namely the 
55 histogram flattening and the inverse histogram flatten- 
ing to the standard image, but a similar effect can also 
be achieved by synthesizing the respective gradation 
conversion tables into a single gradation conversion 



8 



BNSDOCID: <EP _0905650A2_I_> 



15 



EP 0 905 650 A2 



16 



table. 

[0088] Also, in any of the histograms described in the 
foregoing, it is possible to determine and utilize the his- 
togram for a part of the image. 

[0089] As explained in the foregoing, the first invention 5 
enables a gradation conversion capable of converting 
the histogram of a general image into that of the stand- 
ard image, thereby, even in case the image taking con- 
ditions in the X-ray image reading device are unstable, 
obtaining an image in always stable manner, particularly 10 
obtaining an image matching the output characteristics 
of the conventional silver halide-based film from a digital 
X-ray image, through a very simple process. 
[0090] Also since the first invention enables a grada- 
tion conversion capable of converting the histogram of a is 
general image into that of the standard image, it is ren- 
dered possible, in case of X-ray diagnosis of the change 
in the disease of a same patient, to convert the images 
of any time into images of same characteristics through 
a very simple method even if the X-ray image taking 20 
conditions are different from those used in the past or 
unstable, thereby improving the efficiency and accuracy 
of diagnosis. There can also be achieved gradation con- 
version allowing better extraction of the disease to be 
confirmed. 25 
[0091 ] In the following there will be explained the prin- 
ciple of a second invention. 

[0092] In the second invention, an image obtained by 
energy substraction is subjected to gradation conver- 
sion to gradation characteristics similar to those of the 30 
original X-ray image, thereby preventing the loss in the 
efficiency of diagnosis. More specifically, the histogram 
flattening technology is used to match the histogram of 
the image obtained by energy subtraction in general 
manner with the histogram of the original image or that 35 
of a standard X-ray image. 

[0093] A first step of this process consists of preparing 
a gradation conversion table for flattening of the histo- 
gram of the original X-ray images (images before sub- 
traction (or the average of such images)) or that of a 40 
standard X-ray image, and preparing an inverse conver- 
sion table thereof. 

[0094] A second step consists of preparing a grada- 
tion conversion table for, histogram flattening for an 
image obtained by energy subtraction, and passing the 45 
same image through such gradation conversion table 
thereby effecting gradation conversion. In this stage, the 
histogram of an arbitrarily selected general image is flat- 
tened. 

[0095] In a final step, the energy subtraction image so 
subjected to the histogram flattening is subjected to gra- 
dation conversion with the above-mentioned inverse 
conversion table for the original X-ray image or for the 
standard X-ray image. 

[0096] Through the third-step process described 55 
above, the histogram of an arbitrary general image is 
converted to a shape generally similar to that of the 
standard image. • 



[0097] The histogram of a digital image is obtained as 
the frequency distribution of all the pixel values x or a 
part thereof in an image. If such histogram is repre- 
sented by f(x), the histogram flattening is a technology 
of deforming f(x) so as to flatten the density of distribu- 
tion in general manner. The histogram flattening is exe- 
cuted by passing the image data through a gradation 
conversion table H(x) represented by the following for- 
mula: 

Z ></) 

H(x) = (M1-M0)+M0,M01XZM1 (6) 

£ W) 

i=MO 

wherein M0 and M1 are respectively the minimum and 
maximum values of the digital data, in which the depth 
(number of bits) of the input digital data is selected 
same as that of the output digital data (for example in 
the ordinary 12-bit data, M0 = 0 and M1 = 4095). It can 
be easily estimated that such gradation conversion 
table H(x) can convert the gradation of the original 
image with a histogram f(x) to an approximately flat den- 
sity of distribution. 

[0098] The above-described first step prepares a his- 
togram flattening gradation conversion table H 0 (x) from 
the histogram f 0 (x) of a standard image, utilizing the 
equation (6), and then prepares an inversion conversion 
table H 0 *(x). Since H 0 (x) is generally not an analytically 
determined function, the inverse conversion table H 0 *(x) 
which is an inverse function cannot be determined in an 
analytical manner, but a conversion table providing an 
inverse relationship between the input and the output 
can be easily determined through a simple routine pro- 
gram. Otherwise it is also possible to approximate H(x) 
with an analytical function (for example by least square 
method) and to analytically approximate H*(x). The 
inverse conversion table H 0 *(x) thus determined evi- 
dently has a function of converting an image with a flat- 
tened histogram into an image having a histogram 
similar to that of the standard image. This situation is 
illustrated in Fig. 9. 

[0099] In Fig. 9, (a) indicates the histogram f 0 (x) of the 
original X-ray image or the standard image, with the 
pixel values in the abscissa and the frequency in the 
ordinate. In Fig. 9, (b) shows a gradation conversion 
table H 0 (x) for flattening the histogram, in which the 
abscissa indicates the input and the ordinate indicates 
the output, while (c) schematically shows a flattened 
histogram of an output image, obtained by passing the 
image of the histogram (a) through the conversion table 
of the input-output characteristics (b). 
[01 00] The flow (a)-> (b) -> (c) shown in Fig. 9 can be 
traced in the inverse order so that a conversion (c) -> (b) 
-> (a) is also possible (though such conversion is not 
completely reversible since some information is inevita- 
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bly lost in the conversion with the table of a limited 
number of gradation level). In such inverse conversion, 
(b) corresponds to the inverse function H 0 *(x) in which 
the ordinate indicates the input and the abscissa indi- 
cates the output. 

[01 01 ] In the above-described second step, an energy 
subtraction image of a histogram different from that of 
the original X-ray image or the standard image is sub- 
jected to the flattening of histogram also according to 
the equation (6). More specifically, this step prepares a 
histogram flattening gradation conversion table H^x) 
from the histogram f^x) of the energy subtraction 
image, utilizing the equation (6), as shown in Fig. 9. 
[0102] In Fig. 9, (d) indicates the histogram f^x), with 
the pixel values in the abscissa and the frequency in the 
ordinate. In Fig. 9, (e) shows a histogram flattening gra- 
dation conversion table H^x), in which the abscissa 
indicates the input and the ordinate indicates the output, 
while (c) shows a histogram flattened as a result. 
[01 03] In the final step mentioned above, as the image 
of the flattened histogram (c) is converted through the 
table H 0 *(x) shown in (b), it will be easily understood 
that an image having the standard histogram (a) can be 
obtained as the result of such conversion. 
[0104] In the foregoing explanation, it is to be noted 
that, since the image consists of discrete digital values, 
the histogram after passing the histogram flattening 
table is not made completely flat but only shows an 
approximately constant density in general sense, so 
that the histogram of the final image obtained through 
the above-described three steps does not completely 
coincide with the histogram of the standard image. How- 
ever, the images will be recognized, by the human eyes, 
to have substantially coinciding characteristics if the his- 
tograms mutually match in general sense. 
[01 05] This process also functions effectively not only 
for the energy subtracted image but also a subtraction 
image obtained with the ordinary shadowing agent (dif- 
ference between presence and absence of the shadow- 
ing agent, so-called time subtraction). 
[01 06] In the following there will be explained embod- 
iments of the second invention based on the above- 
described principle. 

[01 07] Fig. 1 0 is a block diagram of an embodiment of 
the energy subtraction apparatus, constituting an image 
processing apparatus embodying the second invention, 
wherein components 101 - 112 are similar to those in 
Fig. 1 and will not therefore be explained further. In Fig. 
10 there are additionally provided a memory 113 for 
storing a final image, obtained by the gradation conver- 
sion of the energy subtraction image stored in the mem- 
ory 112; and look-up tables (LUT) 114, 115 for data 
conversion, which are used for the gradation conver- 
sion. 

[01 08] In the following there will be explained the func- 
tions of a first embodiment. 

[0109] The process up to the storage of the energy 
subtraction image in the memory 112*is same as 



explained in the description of the prior art. In the follow- 
ing there will be explained the subsequent gradation 
conversion, with reference to a flow chart shown in Fig. 
11. 

5 [0110] An initial step S101 prepares LUT data for his- 
togram flattening according to the equation (6), based 
on the histogram data of the energy subtraction image 
stored in the memory 112, and stores such LUT data in 
the LUT 114. 

10 [01 1 1 ] Then there is prepared LUT data for histogram 
flattening according to the equation (6). from the histo- 
gram data of an original image in the memory 107, 108 
or an image obtained by averaging these images, and 
an inverse function thereof is calculated and stored in 

75 the LUT 1 1 5 (step S1 02). 

[01 12] In the final stage, the image data obtained by 
energy subtraction are read in succession from the 
memory 112, then subjected to a numerical conversion 
by the LUT 114, and the converted data are further sub- 

20 jected to a numerical conversion by the LUT 115. Thus 
converted image data are in succession stored, as the 
gradation converted image, in the memory 113, and this 
process is executed for all the data in the memory 112 
(stepSl03to S106). 

25 [01 1 3] Through the operations described above, the 
subtraction image obtained in the memory 1 13 are con- 
verted to stable gradation characteristics comparable to 
those of the conventional X-ray image. 
[01 14] In the present embodiment, the LUT 1 1 4 and 

30 the LUT 1 15 are separated, but a similar effect can be 
obtained by synthesizing these numerical conversions 
into a single LUT 

[01 1 5] Also the steps S1 01 , S1 02 in Fig. 1 1 may be 
executed in either order. 
35 [01 16] In the following there will be explained a sec- 
ond embodiment. 

[0117] In the first embodiment, the gradation is 
matched with that of the original image, but the grada- 
tion characteristics need not be particularly matched 

40 with those of the original image but can be matched with 
those of a standard X-ray image, or those ideal for 
observing the energy subtraction image, or those ideal 
for the imaged portion of the human body. 
[01 18] The present embodiment is to change the gra- 

45 dation characteristics to a desired shape, thereby 
obtaining an energy subtraction image with stable gra- 
dation characteristics independent of the image taking 
conditions. 

[0119] More specifically, in the step S102 in Fig. 1 1 , 
so the LUT data of the inverse flattening function to be 
stored in the LUT 1 15 are prepared from desired histo- 
gram data. 

[01 20] Also this step S1 02 can be dispensed with from 
the second time, if the desired histogram data remain 
55 same. 

[0121] In the following there will be explained a third 
embodiment. 

[01 22] The present embodiment is intended for stabi- 
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lizing the gradation characteristics not only of the 
energy subtraction image but also of other subtraction 
methods such as so-called time subtraction image, 
obtained from the difference before and after the admin- 
istration of the shadowing agent. 5 
[0123] In these subtraction methods, a similar histo- 
gram conversion is also possible for an image which is 
obtained, instead of using two image taking conditions, 
by suitable additions or subtractions on a larger number 
of images, thereby erasing or enhancing a particular w 
portion or a particular internal organ. 
[0124] The memory medium 1 10 constituting the sec- 
ond invention stores a program including the process 
shown in Fig. 4, and an effect comparable to that of the 
second invention can be obtained by utilizing such is 
memory medium 1 10 on another system, apparatus or 
computer. The memory medium 110 can be composed 
for example of a semiconductor memory, an optical 
disk, a magnetooptical disk or a magnetic medium. 
[0125] As explained in the foregoing, the second so 
invention allows conversion of the histogram character- 
istics of an energy subtraction image or other subtrac- 
tion images to a desired distribution, thereby providing 
an output image with constantly stable gradation char- 
acteristics, regardless of the image taking conditions. 25 
[0126] The present invention discloses an image 
processing apparatus and an image processing method 
for varying the gradation characteristics of the image, by 
inputting an image signal, detecting the histogram distri- 
bution characteristics of pixel values constituting the 30 
image represented by the inputted image signal and 
converting the detected histogram characteristics into 
arbitrary histogram characteristics. Thus the gradation 
characteristics of plural images obtained from a same 
portion of the object can be converted into desired gra- 35 
dation characteristics, and the gradation characteristics 
of an image obtained by a substrate image processing 
apparatus can be converted close to the gradation char- 
acteristics of the taken original images, whereby the 
deterioration in the efficiency of diagnosis can be pre- 40 
vented. 

Claims 

1 . An image processing apparatus capable of varying 45 
the gradation characteristics of an image, compris- 
ing: 

a) histogram distribution characteristics detec- 
tion means for inputting an image signal and so 
detecting the histogram distribution character- 
istics of pixel values constituting an image rep- 
resented by the inputted image signal; and 
. b) histogram distribution characteristics con- 
version means for converting the histogram ss 
characteristics detected by said histogram dis- 
tribution characteristics detection means into 
' arbitrary histogram distribution*characteristics. 



2. An apparatus according to claim 1, wherein said 
histogram distribution characteristics conversion 
means includes first gradation conversion means 
having gradation conversion characteristics for flat- 
tening the histogram distribution characteristics 
detected by said histogram distribution characteris- 
tics detection means; and second gradation conver- 
sion means having inverse gradation conversion 
characteristics to the gradation conversion charac- 
teristics for flattening the histogram distribution 
characteristics of the pixel values constituting an 
image represented by a reference image signal; 
and said first and second gradation conversion 
means are so arranged that the gradation of an 
image represented by an inputted arbitrary image 
signal is converted by said first gradation conver- 
sion means and then further converted by said sec- 
ond gradation conversion means. 

3. An apparatus according to claim 2, wherein the 
image represented by said reference image signal 
is a standard image prepared in advance and hav- 
ing desired gradation characteristics. 

4. An apparatus according to claim 2, further compris- 
ing display means for visually displaying an image 
represented by said reference image signal and an 
image of which histogram distribution characteris- 
tics are converted by said histogram distribution 
characteristics conversion means. 

5. An apparatus according to claim 2, wherein the 
image represented by said reference image signal 
and the image represented by the image signal 
inputted into said histogram distribution character- 
istics detection means are radiation recording 
images obtained by irradiating a same portion of a 
same object or a same portion of objects of a same 
kind with a radiation and taking the image of the 
transmitted radiation. 

6. An apparatus according to claim 1, wherein said 
histogram distribution characteristics conversion 
means includes first conversion memory table 
preparation means for preparing a first conversion 
memory table by preparing conversion data of gra- 
dation conversion characteristics for flattening the 
histogram distribution characteristics detected by 
said histogram distribution characteristics detection 
means and storing thus prepared conversion data 
in a memory table; histogram distribution character- 
istics generation means for generating the histo- 
gram distribution characteristics of pixel values 
constituting an image represented by the reference 
image signal; and second conversion memory table 
preparation means for preparing a second conver- 
sion memory table by preparing conversion data of 
gradation conversion characteristics inverse to the 



11 



BNSDOCID: <EP_ 



_0905650A2_L> 



21 



EP 0 905 650 A2 



22 



gradation conversion characteristics for flattening 
the histogram distribution characteristics generated 
in said histogram distribution characteristics gener- 
ation means and storing thus prepared conversion 
data as memory table; and said means are so 
arranged that the gradation of an image repre- 
sented by an inputted arbitrary image signal is con- 
verted by the first conversion memory table 
prepared by said first conversion memory table 
preparation means and further converted by the 
second conversion memory table prepared by said 
second conversion memory table preparation 
means. 

7. An apparatus according to claim 6. wherein said 
histogram distribution characteristics detection 
means is adapted to detect the histogram charac- 
teristics from the pixel values of at least a part of the 
pixels constituting the image represented by the 
inputted image signal, and said histogram distribu- 
tion characteristics generation means is adapted to 
generate the histogram characteristics from the 
pixel values of at least a part of the pixels constitut- 
ing the reference image represented by the refer- 
ence image signal. 

8. An apparatus according to daim 1, wherein said 
histogram distribution characteristics conversion 
means includes first gradation conversion means 
adapted to prepare conversion data having grada- 
tion conversion characteristics for flattening the his- 
togram distribution characteristics detected by said 
histogram distribution characteristics detection 
means, to convert, accorcfing to said prepared con- 
version data, the gradation of an image repre- 
sented by an arbitrary image signal inputted into 
said histogram distribution characteristics detection 
means and to output the image with thus converted 
gradation, and second gradation conversion means 
adapted to select one of plural conversion memory 
tables respectively containing conversion data of 
gradation conversion characteristics inverse to the 
gradation conversion characteristics for flattening 
the histogram distribution characteristics of the 
pixel values constituting an image represented by 
an arbitrary image signal, to convert, according to 
the conversion data contained in the selected con- 
version memory table, the gradation of the image 
represented by the image signal outputted from 
said first gradation conversion means and to output 
the image with thus converted gradation. 

9. An apparatus according to claim 1 , further compris- 
ing a computer-readable memory medium storing a 
program for executing the processing operations in 
said histogram distribution characteristics detection 
means and said histogram distribution characteris- 
tics conversion means, wherein thrf processing 



operations are controlled by a computer functioning 
according to the program stored in said memory 
medium. 

5 10. An image processing method capable of varying 
the gradation characteristics of an image, compris- 
ing: 

a) a histogram distribution characteristics 
w detection step of detecting the histogram distri- 
bution characteristics of pixel values constitut- 
ing an image represented by an inputted image 
signal; and 

b) a histogram distribution characteristics con- 
15 version step of converting the histogram char- 
acteristics detected by said histogram 
distribution characteristics detection step into 
arbitrary histogram distribution characteristics. 

20 1 1 . A method according to claim 1 0, wherein said histo- 
gram distribution characteristics conversion step 
includes a first gradation conversion step having 
gradation conversion characteristics for flattening 
the histogram distribution characteristics detected 

25 by said histogram distribution characteristics detec- 
tion step; and a second gradation conversion step 
having inverse gradation conversion characteristics 
to the gradation conversion characteristics for flat- 
tening the histogram distribution characteristics of 

30 the pixel values constituting an image represented 
by a reference image signal; and said first and sec- 
ond gradation conversion steps are so arranged 
that the gradation of an image represented by an 
arbitrary image signal is converted by said first gra- 

35 dation conversion step and then further converted 
by said second gradation conversion step. 

1 2. A method according to claim 1 1 , wherein the image 
represented by said reference image signal is a 

40 standard image prepared in advance and having 
desired gradation characteristics. 

1 3. A method according to claim 1 1 , further comprising 
a display step of visually displaying an image repre- 

45 sented by said reference image signal and an 
image of which histogram distribution characteris- 
tics are converted by said histogram distribution 
characteristics conversion step. 

so 1 4. A method according to claim 1 1 , wherein the image 
represented by said reference image signal and the 
image processed in said histogram distribution 
characteristics detection step are radiation record- 
ing images obtained by irradiating a same portion 

55 of a same object or a same portion of objects of a 
same kind with a radiation and taking the image of 
the transmitted radiation. 
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1 5. A method according to claim 10, wherein said histo- 
gram distribution characteristics conversion step 
includes a first conversion memory table prepara- 
tion step of preparing a first conversion memory 
table by preparing conversion data of gradation s 
conversion characteristics for flattening the histo- 
gram distribution characteristics detected by said 
histogram distribution characteristics detection step 
and storing thus prepared conversion data in a 
memory table; a histogram distribution characteris- w 
tics generation step of generating the histogram 
distribution characteristics of pixel values constitut- 
ing an image represented by the reference image 
signal; and a second conversion memory table 
preparation step of preparing a second conversion 15 
memory table by preparing conversion data of gra- 
dation conversion characteristics inverse to the gra- 
dation conversion characteristics for flattening the 
histogram distribution characteristics generated in 
said histogram distribution characteristics genera- 20 
tion step and storing thus prepared conversion data 

as a memory table: and said means are so 
arranged that the gradation of an image repre- 
sented by an arbitrary image signal is converted by 
the first conversion memory table prepared by said 2 5 
first conversion memory table preparation step and 
further converted by the second conversion mem- 
ory table prepared by said second conversion 
memory table preparation step. 

30 

16. A method according to claim 15, wherein said histo- 
gram distribution characteristics detection step is 
adapted to detect the histogram characteristics 
from the pixel values of at least a part of the pixels 
constituting the image represented by the image 35 
signal, and said histogram distribution characteris- 
tics generation step is adapted to generate the his- 
togram characteristics from the pixel values of at 
least a part of the pixels constituting the reference 
image represented by the reference image signal 40 

1 7. A method according to claim 1 0, wherein said histo- 
gram distribution characteristics conversion step 
includes a first gradation conversion step adapted 

to prepare conversion data having gradation con- 45 
version characteristics for flattening the histogram 
distribution characteristics detected by said histo- 
gram distribution characteristics detection step, to 
convert, according to said prepared conversion 
data, the gradation of an image represented by an so 
arbitrary image signal, and a second gradation con- 
version step adapted to prepare plural conversion 
memory tables respectively containing conversion 
data of gradation conversion characteristics inverse 
to the gradation conversion characteristics for flat- 55 
tening the histogram distribution characteristics of 
the pixel values constituting an image represented 
by an arbitrary image signal, to select one of said 



plural conversion memory tables and to further 
effect, according to the conversion data contained 
in the selected conversion memory table, the gra- 
dation conversion of the image subjected to the gra- 
dation conversion in said first gradation conversion 
step. 

18. A method according to claim 10, which comprises 
using a computer-readable memory medium stor- 
ing a program for executing the processing opera- 
tions in said histogram distribution characteristics 
detection step and said histogram distribution char- 
acteristics conversion step, and being executed by 
a computer functioning according to the program 
stored in said memory medium. 

19. An image processing apparatus for processing plu- 
ral images obtained under mutually different image 
taking conditions, comprising: 

a) differential image signal generation means 
for inputting plural image signals correspond- 
ing to plural images obtained under mutually 
different image taking conditions, and generat- 
ing a differential image signal corresponding to 
a differential image of the images represented 
by the inputted plural image signals; and 

b) histogram distribution characteristics con- 
version means for inputting the differential 
image signal generated by said differential 
image signal generation means and converting 
the histogram distribution characteristics of the 
pixel values constituting the differential image 
represented by the inputted differential image 
signal into arbitrary histogram distribution char- 
acteristics. 

20. An apparatus according to claim 19, wherein said 
differential image is a differential image of plural 
radiation images obtained by irradiating a same 
object with radiations of varied energy distributions 
and taking the transmitted image. 

21. An apparatus according to claim 19, wherein said 
differential image is a differential image of plural 
radiation images obtained by irradiating a same 
object with a radiation and taking the transmitted 
images at mutually different timings. 

22. An apparatus according to claim 19, wherein said 
arbitrary histogram distribution characteristics are 
histogram distribution characteristics of pixel values 
constituting any of plural images obtained under 
mutually different image taking conditions. 

23. An apparatus according to claim 19, wherein said 
histogram distribution characteristics conversion 
means includes a conversion memory table storing 
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conversion data for converting the histogram distri- 
bution characteristics. 

24. An apparatus according to claim 23, wherein said 
conversion memory table includes a first conver- 
sion memory table for flattening the histogram dis- 
tribution characteristics of pixel values constituting 
said differential image, and a conversion memory 
table storing conversion data of inverse conversion 
characteristics to the conversion characteristics 
stored in a second conversion memory table for flat- 
tening arbitrary histogram distribution characteris- 
tics. 

25. An apparatus according to claim 19, further com- 
prising a computer-readable memory medium stor- 
ing a program for executing the processing 
operations in said differential image signal genera- 
tion means and said histogram distribution charac- 
teristics conversion means, wherein the processing 
operations are controlled by a computer functioning 
according to the program stored in said memory 
medium. 

26. An image processing method for processing plural 
images obtained under mutually different image 
taking conditions, comprising: 

a) a differential image signal generation step of 
inputting plural image signals corresponding to 
plural images obtained under mutually different 
image taking conditions, and generating a dif- 
ferential image signal corresponding to a differ- 
ential image of the images represented by the 
inputted plural image signals; 

and 

b) a histogram distribution characteristics con- 
version step of inputting the differential image 
signal generated by said differential image sig- 
nal generation step and converting the histo- 
gram distribution characteristics of the pixel 
values constituting the differential image repre- 
sented by the inputted differential image signal 
into arbitrary histogram distribution characteris- 
tics. 

27. A method according to claim 26, wherein said dif- 
ferential image is a differential image of plural radi- 
ation images obtained by irradiating a same object 
with radiations of varied energy distributions and 
taking the transmitted image. 

28. A method according to claim 26, wherein said dif- 
ferential image is differential image of plural radia- 
tion images obtained by irradiating a same object 
with a radiation and taking the transmitted images 
at mutually different timings. 



29. A method according to claim 26, wherein said arbi- 
trary histogram distribution characteristics are his- 
togram distribution characteristics of pixel values 
constituting any of plural images obtained under 

5 mutually different image taking conditions. 

30. A method according to claim 26, wherein said histo- 
gram distribution characteristics conversion step is 
adapted to convert the histogram distribution char- 

10 acteristics of pixel values constituting the differen- 
tial image represented by the inputted differential 
image signal into arbitrary histogram distribution 
characteristics, utilizing a conversion table storing 
conversion data for converting the histogram distri- 

15 bution characteristics. 

31. A method according to claim 30, wherein said con- 
version table includes a first conversion table for 
flattening the histogram distribution characteristics 

20 of pixel values constituting said differential image, 
and a conversion table having inverse conversion 
characteristics to the conversion characteristics of 
a second conversion table for flattening arbitrary 
histogram distribution characteristics. 

25 

32. A method according to claim 26. which comprises 
using a computer-readable memory medium stor- 
ing a program for executing the processing opera- 
tions in said differential image signal generation 

30 step and said histogram distribution characteristics 
conversion step, and being executed by a compu- 
ter, functioning according to the program stored in 
said memory medium. 

35 



40 



45 



50 



55 



14 



<EP 090 56 50 A2 I > 



EP0 905 650 A2 




15 



BNSDOCID: <EP 090 5650 A2J_> 



V 

EP 0 905 650 A2 




16 



BNSDOCID: <EP 0905650 A2 J _> 



EP 0 905 650 A2 




17 



BNSDOCID: <EP 0905650A2_I_> 



EP 0 905 650 A2 



CD 




0<C£T 
OQQ.D 




OS 

f=CQ 
QQC 

zuj 

o> 

LUO 
COO 



in 



LU — 

> 



CO. 



2=Q-UJ 



C\J 




18 



BNSDOCID: <EP 0905650A2J_> 



EP 0 905 650 A2 




19 



BNSDOCID: <EP 0905650 A2_l_> 



EP 0 905 650 A2 



FIG. 6 



( START ) 



SELECT AND OBTAIN STANDARD IMAGE OF IMAGE 
PROCESSED RESULT, FILM DIGITIZED RESULT OR 
IMAGE OBTAINED IN GOOD CONDITION 



S1 



S2 



CALCULATE HISTOGRAM (IMAGE FREQUENCY 
DISTRIBUTION) f(x) OF STANDARD IMAGE 



S3 



PREPARE HISTOGRAM FLATTENING GRADATION 
CONVERSION TABLE H(x) ACCORDING TO FORMULA (5) 



PREPARE INVERSE CONVERSION TABLE OF H(x) 



S4 



SET INVERSE CONVERSION TABLE INTO GRADATION 
CONVERSION TABLE 13 THROUGH INTERFACE 16 



S5 



7XT 

( END ) 



20 



O905650A2J > 



J 



EP 0 905 650 A2 



FIG. 7 



33 




34 




35 



PRINTER 



STORAGE 
MEDIUM 



s 



32 



31 



CPU 




TO EXTERNAL 
DEVICE 



21 



BNSDOCID: <EP 09056 S0A2J_> 



EP 0 905 650 A2 



FIG. 8 

( START ) 



S11 



OBTAIN DIAGNOSTIC IMAGE IN THE PRESENT STATE (IMAGE A) 



S12 



RETRIEVE AND EXTRACT PAST 
IMAGE OF SAME PATIENT 



S13 



SET PAST IMAGE AS 
STANDARD IMAGE (IMAGE B) 



S17 



OBTAIN HISTOGRAM OF 
IMAGE A 



S14 



OBTAIN HISTOGRAM OF 
IMAGE B 



S15 



PREPARE HISTOGRAM 
FLATTENING GRADATION 
CONVERSION TABLE HO(x) OF 
IMAGE B 



S18 



PREPARE HISTOGRAM 
FLATTENING GRADATION 
CONVERSION TABLE H1(x) OF 
IMAGE A 



J2L 



S16 



PREPARE INVERSE 
CONVERSION TABLE HO*(x) 
OF HO(x) 



S19 



CONVERT GRADATION OF 
IMAGE A BY USING H1(x) 
(HISTOGRAM FLATTENING) TO 
MAKE IMAGE A' 



S20 



EXECUTE GRADATION CONVERSION 
FOR IMAGE A' BY USING 
GRADATION CONVERSION TABLE 
HO(x) TO MAKE IMAGE A" 



S21 



COMPARE AND EXAMINE IMAGE A" 
AND IMAGE B TO OBSERVE 
CHANGE OF CONDITION OF 
PATIENT 



( END ) 



22 



090S6S0A2J > 




23 



BNSDOCID: <EP 09056 50A2_I_> 




BNSDOCID: <EP 0905650 A2J_> 



24 



EP 0 905 650 A2 



FIG. 11 

( START ) 



PREPARE LUT DATA WHICH EXECUTES HISTOGRAM 
FLATTENING BY USING IMAGE DATA OF MEMORY 112 
AND STORE IT IN LUT 114 






PREPARE LUT DATA WHICH EXECUTES HISTOGRAM 
FLATTENING BY USING ACCUMULATED HISTOGRAM IN 
MEMORY 107 OR MEMORY 108 AND STORE INVERSE 
FUNCTION DATA OF THE LUT DATA IN LUT 115 
AS LUT DATA 




r 




READ PIXEL VALUE IN DIFFERENCE MEMORY 112 






NUMERICAL-VALUE CONVERT READ PIXEL VALUE 
BY LUT 114 






NUMERICAL-VALUE CONVE 
CONVERTED AND STORE C 
VALUE 


RT THE NUMERICAL VALUE 
r IN MEMORY 113 PIXEL 



S101 



S102 



S103 



S104 




S105 



( END ) 



25 



BNSDOCID: <EP 0905650A2_L> 



THIS PAGE BLANK 



(USPTO) 



(19) 



J) 



in 



(12) 



Europalsches Patentamt 
European Patent Office 
Off ice europSen des brevets (11) EP 0 905 650 A3 

EUROPEAN PATENT APPLICATION 



(88) Date of publication A3: 

27.10.1999 Bulletin 1999/43 

(43) Date of publication A2: 

31 .03.1 999 Bulletin 1 999/1 3 

(21) Application number: 98117922.9 

(22) Date of filing: 22.09.1998 



(51) Int. CI. 6 : G06T5/40 



(84) Designated Contracting States: 


(72) Inventor: Inoue, Hitoshi 


AT BE CH CY DE DKESRFRGB GR IE IT LI LU 


Ohta-ku, Tokyo (JP) 


MCNLPTSE 




Designated Extension States: 


(74) Representative: 


AL LT LV MK RO SI 


Tiedtke, Harro, Dipl.-lng. et al 




Patentanwattsburo 


(30) Priority: 24.09.1997 JP 25875397 


Tiedtke-Buhling-Kinne & Partner 


03.04.1998 JP 9171398 


Bavariaring 4 




80336 Munchen (DE) 


(71) Applicant: 




CANON KABUSHIKI KAISHA 




Tokyo (JP) 





CO 

< 

LO 
CO 

to 



(54) Image enhancement processing apparatus and method 



(57) The present invention discloses an image 
processing apparatus and an image processing method 
for varying the gradation characteristics of the image, by 
inputting an image signal, detecting the histogram distri- 
bution characteristics of pixel values constituting the 
image represented by the inputted image signal and 
converting the detected histogram characteristics into 
arbitrary histogram characteristics. Thus the gradation 
characteristics of plural images obtained from a same 



portion of the object can be converted into desired gra- 
dation characteristics, and the gradation characteristics 
of an image obtained by a substrate image processing 
apparatus can be converted close to the gradation char- 
acteristics of the taken original images, whereby the 
deterioration in the efficiency of diagnosis can be pre- 
vented. 



FIG. 3 



r24 



ICONTRO^ 

i r 



3 OFFSPT SHADING 

? o mSiSJy distribution 

V V I 4 L— S_l IMEMOfff I ^ 

1 \ f\ a„7_ 23 ^ I FRAME ME1 



FRAME MEMORY"! — ^ 




.10 





CONVERSION 




DATA 




PREPARATION 




UNrr 



Q. 
LU 



Primed by Xerox (UK) Business Services 
2.16.7/3.6 



BNSDOCID: <EP 0905650A3_I_> 



EP 0 905 650 A3 



European Patent 
Office 



EUROPEAN SEARCH REPORT 



Application Number 

EP 98 11 7922 



DOCUMENTS CONSIDERED TO BE RELEVANT 



Category 



Citation of document with indication, where appropriate, 
of relevant passages 



Relevant 
to claim 



CLASSIFICATION OF THE 
APPLICATION (IntCLS) 



A 

X 

A 

A 



US 4 950 894 A (HARA MAK0T0 ET AL) 
21 August 1990 (1990-08-21) 
* column 7, line 9-61 * 
column 9, line 23-29 * 
figures 1,3 * 



PATENT ABSTRACTS OF JAPAN 
vol. 096, no. 006, 
28 June 1996 (1996-06-28) 
& JP 08 032827 A (T0PPAN PRINTING CO LTD), 
2 February 1996 (1996-G2-02) 
* abstract * 



PATENT ABSTRACTS OF JAPAN 
vol. 014, no. 322 (C-0739), 
10 July 1990 (1990-07-10) 
& JP 02 114931 A (TOSHIBA CORP), 
27 April 1990 (1990-G4-27) 
* abstract * 



US 5 253 281 A (KRAUSS PETER) 
12 October 1993 (1993-10-12) 

* abstract; figures 2-4 * 

FR 2 700 230 A (ISRAEL DEFENCE) 
8 July 1994 (1994-07-08) 

* abstract * 



The p ra eent aearnh report h oj bean dra wn up for al l e Ww 



,9,10, 
8 



2,6,8, 
11,15,17] 

1,9.10, 
18 



2,6,8, 
11,15,17 

1,9,10, 
18 



G06T5/40 



2,6,8, 
11,15,17 

2,11 



6,15 



TECHNICAL FIELDS 
SEARCHED (lnt.CI.6) 



G06T 

G01D 
GO IT 
H04N 



Place o» search 



BERLIN 



Date of conplelion of the search 

18 May 1999 



Jonsson, P 



CATEGORY OF CITED DOCUMENTS 

X : particularly relevant if taken alone 

Y : particularly relevant if oombirted with another 

document of the same category 
A : technological background 
O : non-written disclosure fc 
P : intermediate document 



T : theory or prinople underlying the invention 
E : earlier patent document, but published on, or 

after the firing date 
D : document cited in the application 
L : document cited for other reasons 



& : member of the same patent family, oorretponding 
document 



2 



090 56 50 A3 . I > 



EP 0 905 650 A3 



ANNEX TO THE EUROPEAN SEARCH REPORT 
ON EUROPEAN PATENT APPLICATION NO. 



EP 98 11 7922 



This annex lists the patent family members relating to the patent documents cited in the above-mentioned European search report. 
The members are as contained in the European Patent Office EDP file on 

The European Patent Office is in no way liable for these particulars which are merely given for the purpose of information. 

18-05-1999 



Patent document 
cited in search report 



Publication 
date 



Patent family 
members) 



Publication 
date 



US 4950894 



21-08-1990 



JP 
JP 
JP 
JP 
JP 
JP 
JP 
OE 
EP 



61170729 A 

61170730 A 
1862403 C 
5069347 B 

63031640 A 
6061325 B 

63031641 A 
3688563 A 
0189209 A 



FR 2700230 



08-07-1994 



IL 
CA 
DE 
FR 
GB 



102904 
2104571 
4328128 
2695229 
2269958 



01-08- 
81-08- 
08-08- 
30-09- 
10-02- 
17-08- 
10-02- 
22-07- 
30-07- 



1986 
1986 
1994 
1993 
1988 
1994 
1988 
1993 
1986 



JP 08032827 


A 


02- 


■02- 


•1996 


NONE 


JP 02114931 


A 


27- 


•04- 


-1990 


NONE 


US 5253281 


A 


12- 


-10- 


-1993 


NONE 



06-12-1998 

22- 02-1994 
24-02-1994 
04-03-1994 

23- 02-1994 



Sj For more details about this annex : see Official Journal of the European Patent Office, No. 1 2/82 



_0905650A3_I_> 



THIS PAGE BLANK ojspto, 



